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RANDOM ITERATION WITH PLACE DEPENDENT 

PROBABILITIES 

RAFAL KAPICA AND MACIEJ SLECZKA 

Abstract. Markov chains arising from random iteration of functions 
^^ I Sg : X ^ X, ^ Q^ where X is a Polish space and 8 is arbitrary set 

of indices are considerd. At x S A^, ^ is sampled from distribution dx 
on Q and "dx are different for different x. Exponential convergence to 
a unique invariant measure is proved. This result is applied to case of 
^^ \ random affine transformations on W^ giving existence of exponentially 

attractive perpetuities with place dependent probabilities. 

PLh 

-^ ■ 1. Introduction 

We consider Markov chain of the form Xq = xq, Xi = Se^i^xo), X2 
Sqi o Sooixo) and inductively 

"> 

t^ ! Xn+i = Se„{Xn), (1) 

O 

Pr i where 89^, Sei,---,Sg„ are randomly chosen from a family {Se : 6* G 0} of 

1^ I functions that map a state space X into itself. If chain is at x G X then 

O I ^ G is sampled from distribution t?a; on 0, where i!}x are, in general, 

different for different x. We are interested in the rate of convergence to 

stationary distribution //* on X, i.e. 



X 



P{Xn E A} -^ iJ.^{A) as n -^ 00. (2) 

In case of constant probabilities, i.e. "dx = ^y for x,y E X, the basic tool 
when studying asymptotics of ([1]) are backward iterations 

Yn+i = Sqo o Se^ o ... o Se„{x). 

Since X„ and y„ are identically distributed and, under suitable conditions, 
Yn converge almost surely at exponential rate to some random element Y, 
one obtains exponential convergence in ([2]) (see [H] for bibliography and 
excellent survey of the field) . For place dependent dx we need different ap- 
proach because distributions of X„ and Y^ are not equal. 
The simplest case when = {1, ..., n} is treated in [2] and [20], where exis- 
tence of a unique attractive invariant measure is established. Similar result 
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2 RAFAL KAPICA AND MACIEJ SLECZKA 

holds true when 9 = [0, T] and "d^ are absolutely continuous (see [13] )■ Re- 
cently it was shown that the rate of convergence in case of G = {1, ..., n} is 
exponential (see pT|). 

In this paper we treat general case of place dependent d^ for arbitrary B and 
prove the existence of a unique exponentially attractive invariant measure 
for ([T]). Our approach is based on coupling method which can be briefly 
described as follows. For arbitrary starting points x, x G X we consider 
chains (Xn)nGNo) (-^n)neNo "with Xq = Xq, Xq = Xq and try to build corre- 
lations between {Xn)neNo and (X„)„gNo in order to make their trajectories 
as close as possible. This can be done because transition probability func- 
tion B^^y{A) = P{{Xn+i,Xn+i) G A\{Xn,Xn) = {x,y)} of the coupled 
chain (X„, Xn)nmo taking values in X"^ can be decomposed (see |pjj) in the 
following way 

where sub-probabilistic measures Q^^^j, are contractive in metric d ow X: 

d{u, v) Qx.y{du, dv) < ad{x, y) 

for some constant a G (0, 1). 

Since transition probabilities for ([T]) can be mutually singular for even very 
close points, one cannot expect that chains (X„)„gNo and {Xn)n&% couple 
in finite time (X„ = X^ for some n G Nq) as in classical coupling construc- 
tions ([16]) leading to convergence in total variation norm. On the contrary, 
they only couple at infinity ((i(X„,X„) — >■ as n — > oo) so this method is 
sometimes called asymptotic coupling ([I2]) and gives convergence in *-weak 
topology. 

The paper is organized as follows. In Section 2 we formulate and prove the- 
orem which assures exponential convergence to invariant measure for a class 
of Markov chains. This theorem is applied in Section 3 to chains generated 
by random iteration of functions. In Section 4 we discuss special class of 
such functions, random affine transformations on M*^, thus generalizing the 
notion of perpetuity to place dependent case. 

2. An exponential convergence result 

2.1. Notation and basic definitions. Let {X,d) be a Polish space, i.e. 
a complete and separable metric space and denote by Bx the a-algebra 
of Borel subsets of X. By Bi,{X) we denote the space of bounded Borel- 
measurable functions equipped with the supremum norm, Cb{X) stands 
for subspace of bounded continuous functions. By A4fin{X) and A^i(X) 
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we denote the sets of Borel measures on X such that ^{X) < oo for /i G 
Mfin{X) and fi{X) = 1 for ^ G Mi{X). Elements of Mi{X) are called 
probability measures. Elements of Aifin{X) for which fi{X) < 1 are called 
sub-probabilistic. By supp fi we denote the support of the measure fi. We 
also define 



M^iX) = {/i G MiiX) : / L{x)/i{dx) < cx)} 

Jx 

where L : X — ?> [0, oo) is arbitrary Borel measurable function and 

M\{X) = {fi e Mi{X) : / d{x, x)fj,{dx) < oo}, 

Jx 

where x G X is fixed. Definition of Ai\{X) is independent of the choice of 

X. 

The space A^i(X) is equipped with the Fourtet-Mourier metric: 

11^1 - ^2||fm = sup{| / f{x){iJi - ^2){dx)\ : / G J"}, 

Jx 

where 

J^={fea{X):\f{x)-f{y)\<l and |/(x)| < 1 for x,y e X}. 
The space A^J(X) is equipped with the Wasserstein metric: 

Wl^i - yW2|U = sup{| / /(x)(/xi - fJ.2){dx)\ : f G W}, 
Jx 

where 

W = {feC,{X):\f{x)-f{y)\<l for x,yGX}. 

By II ■ II we denote the total variation norm. If the measure ^ is nonnegative 
then ||yu|| is simply the total mass of /i. 

Let P : Bb{X) — )> Bb{X) be the Markov operator, i.e. linear operator 
satisfying Plx = Ix and Pf{x) > if / > 0. Denote by P* the dual 
operator, i.e operator P* : Aifin{X) — )> A^jj„(X) defined as follows 

P*fi{A) := I PlA{x)^{dx) for A G Bx- 
Jx 

We say that /i* G A^i(X) is invariant for P if 

/ P f (x) j2^,{dx) = / f{x)j2^,{dx) for every / G Bh{X) 
Jx Jx 

or, alternatively, we have P*/i* = /i*. 

By {Pj, : X G X} we denote the transition probability function for P, i.e. 
the family of measures Px G A^i(X) for x E X such that maps x h- )■ P2:(A) 
are measurable for every A G -Bx and 

Pfi^) = [ f{y)Px{dy) for xeX and / G ^^(X) 
Jx 
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or equivalently P*iJ,{A) = J^ Px{A)^{dx) for A e Bx and ^ G Mfin{X). 

2.2. Formulation of the theorem. 

Definition 2.1. A coupling for {P^ : x G X} is a family {Bx,y '■ x,y E X} 
of probabilistic measures on X x X such that for every B G Bx^ the map 
X^ 3 {x,y) I— )■ Bx^y{B) is measurable and 

Bx,y{A XX)= P,(A), B^^yiX XA)= Py{A) 

for every x,y E X and A G Bx- 

In the following we assume that there exists the family {Qx,y '■ x,y E X} 
of sub-probabilistic measures on X^ such that maps {x,y) h-)- Q,x,y{B) are 
measurable for every Borel B C X"^ and 

qx,y{A xX)< Px{A) and Q,,y(X x A) < Py{A) 

for every x,y E X and Borel A G X. 

Measures {Qx,y '■ x,y E X} allow us to construct couphng for {P^ : x E X}. 
Define on X"^ the family of measures {R.x,y '■ x,y E X}, which on rectangles 
A X B axe given by 

RxA^ xB) = Y3Q7-p^(P-(^) - Q--^(^ X XmPyiB) - QxAX X B)), 

when Cl^^y{X^) < 1 and I{.x,y{A x B) = otherwise. A simple computation 
shows that family {Bx,y : x,y E X} of measures on X^ defined by 

Bx,y = Qx,y + Rx,y for X,y E X 

is coupling for {P^ : x E X}. 

For every r > define Dr = {{x, y) E X^ : d{x^ y) < r }. 

Now we list assumptions on Markov operator P and transition probabilities 

{Qx,y ■■ x,y E X}. 

AO P IS a Feller operator, i.e. P{Cb{X)) C Cb{X). 

Al There exists a Lapunov function for P, i.e. continuous function L : 

X — )■ [0, oo) such that L is bounded on bounded sets, lim^^-^oo L{x) = +oo 

and for some A G (0, 1), c > 

PL{x) < \L{x) + c for X E X. 
A2 There exist F C X"^ and a E (0, 1) such that supp€lx,y C F and 

/ d{u,v)Qx,y{du,dv) < ad{x,y) for {x,y) E F. (3) 

A3 There exist R > 0, 6 > 0, I > and v E (0, 1] such that 

1 - IIQx.yll < ld{x,yY and Qx,yiDadix,y)) > S (4) 
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for {x, y) eDrH F. 

A4 There exist j3 G (0, 1) and C > such that for 

k{ (x„, yn)n&% ) = inf {ri G No : (x^, |/„) E DrHF} 

we have 

_ ~ Ac 

^xo,yoP "" <C whenever L{xo) + L{yo) < _ , 

where IEa;o,s/o denotes here expectation with respect to chain starting from 
{xo,yo) and with trasition function {^x,y '■ x,y E X}. 

Remark. Condition A4 means that dynamics quickly enters the domain 
of contractivity F. In this paper we discuss Markov chains generated by ran- 
dom iteration of functions for which always F = X"^ and L{x) = d{x, x) with 
some fixed x G X, so A4 is trivially fulfilled when R = ■^^. There are, how- 
ever, examples of random dynamical systems for which F is a proper subset 
of X^. Indeed, in contractive Markov systems introduced by I. Werner in 
[22] we have X = Yl'i=i -^i but F = ^^^^ Xj x Xj. They will be studied in 
a subsequent paper. 

Now we formulate the main result of this section. Its proof is given in 
Section 2.4. 

Theorem 2.1. Assume AO - A4. Then operator P possesses a unique 
invariant measure /i* G A^f (X), which is attractive, i.e. 

lim / F"/(a;) ^{dx) = [ f{x) fi{dx) for f G CbiX), ^ G A^i(X). 
"^°° Jx Jx 

Moreover, there exist q E (0,1) and C > such that 

||^*> - I^*\\fm < g"C(l + / L{x)^{dx)) (5) 

Jx 

for fi E Mf{X) and n eN. 

2.3. Measures on the pathspace. For fixed {xo,yo) £ X^ the next step 
of the chain with transition probability function B^ ^ = Q^._y + Hx,y can 
be drawn according to Qxo,yo or according to Ra;o,j/o- To distinguish these 
two cases we introduce augmented space X = X^ x {0, 1} and transition 
function {Bx,y,e '■ {x,y, 9) E X} on X given by 

'^x,y,e = Qa:,j/ X 5i -|- 'R.x,y X ^O- 

Parameter 6 E {0, 1} is responsible for choosing measures Q,x,y and Rx,y 
If Markov chain with transition function 'Qx,y,e at time n stays in the set 
X^ X {1} it means that the last step was drawn according to Q^.y, for some 
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{x,y)eX\ 

For every x & X finite-dimensional distributions pO'-'"- g A^i(X"+^) are 

defined by 



P"'-'"(S) = / ii{dxo) / Px^{dX2)... / Pa;„_i(<ix„)lB(xo,...,Xn) 

7x Jx Jx 

for 77, G No, B G i3xn+i- By Kolmogorov extension tlieorem we obtain 
measure P^ on patlispace X°°. Similarly we define measures B!^j^, Bl^^^g 
on (X X X)°° and X°°. These measures have the following interpretation. 
Consider Markov chain (X„, i^)ngNo on X x X, starting from (xq, yo), with 
transition function {B^^y : x,y E X}, obtained by canonical Kolmogorov 
construction, i.e. Q = {X x X)°° is sample space equipped with probability 
measure P = B^^^^^, X„(cj) = x„, Yn{uj) = ?/„, where u = {xk,yk)keNo ^ ^, 
and n G Nq. Then (X„)„gN(,, (yn)neNo are Markov chains in X, starting 
from Xq and y^, with transition function {P^ '■ x G X}, and P'^, P'^ are 
their measures on pathspace X°°. 

In this paper we often consider marginals of measures on the pathspace. If 
|U is a measure on a measurable space X and / : X — )■ F is a measurable 
map, then /*/i is the measure on Y defined by f^ii^A) = fi{f~^{A)). So, if 
we denote by pr the projection map from a product space to its component, 
then pr*yU is simply the marginal of /x on this component. 
In the following we consider Markov chains on X with transition function 
{Bx,y,e '■ x,y E X,9 E {0, 1}}. We adopt as a convention that ^o = 1, that 
is $ always starts from X^ x {1}, and define 

T300 R°° 

x,y ' x,y,l' 



For b G Mfin{X'^) we write 

B^{B) = [ B^y{B) b{dx, dy), Be %^ 
Jx 

and 

Qb{A) = [ Q.,y{A) b{dx, dy), Ae Bx^. 
Jx2 

When studying asymptotics of chain (X„)„gMo with transition function {P^ : 
X G X} it is particularly interesting whether coupled chain {Xn,Yn)neNo 
is moving only accordingly to contractive part Q,x,y of transition function 
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^x,y For every sub-probabilistic measure b G AifmiX"^) we define sub- 
probabilistic finite- dimensional distributions Q^''"'" G A4fin{{X x X)"+^) 

Q°--"(5) = / b{dxo,dyo) Qx^^y,Xdxi,dyi)... 

Qx„_i,y„_iii?((a;o, yo), •••, (a;„, y„)), 

where i? G 'B(xxX)"+i, ^ ^ No- Since family {Q^''"'" : n G No} need not be 
consistent, we cannot use Kolmogorov extension theorem to obtain measure 
on the whole pathspace X°°. However, defining for every b G A^/j„(X^) 
measure Q^ G MfiniX°°) by 

where B G Bj^^, one can easily check that for every cylindrical set B = 

A X X°°, A G %n, we have 

QriB)= limQ°--"(pr(x.).+i(A)). 

71— >00 

2.4. Proof of Theorem 12.11 Before proceeding to the proof of Theorem 
I2.1l we formulate two lemmas. The proof of the first one is due to C Odasso 
and can be found in [19] as a part of larger reasoning. Since it is very useful 
in coupling constructions we formulate it here explicitly and reproduce its 
proof. 

Lemma 2.1. Let Y be a metric space and V : Y ^ [0, C)o) a measurable 
function. Let {Y^°)neno be a family of Markov chains with common tran- 
sition function, indexed by starting point yo E Y . Suppose that there exist 
constants Vq > 0, A G (0, 1), C > such that for 

Pi{yk)keh%) = inf{A; G Nq : V{yk) < Vq} 

we have 

Ey,\-'<C{V{yo) + l)} for y,eY, 

where Ey^ is expectation induced by (y^°)„GNo- 

Let B C F°° be measurable and such that for somep > we have Fy^lB) > p 
for every yo satisfying V{yo) < Vq. Then there exist constants 7 G (0, 1) 
and C > such that for 

'ri?((yfc)fceN„) = inf{n G No : (l/n+fc)fceNo G B} 
we have 

E,„7-"" < CiV{yo) + 1) for yo G Y. 
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Proof of Lemma \2.1\ 

Fix yo G Y . Define the time of n-tli visit in {y G F : V{y) < Vq}: 

Pi= P 
Pn+i = pn + P°T^„ for n> I, 
wliere Tn{{yk)keh%) = {yk+n)kei>%- Strong Markov property implies tliat 

Ey,iX-PoTjT^J=EyJX''') for n G N, 
wliere J-'p„ is a -algebra in Y°° generated by p„- Since V{Yp^) < Vq we have 

Taking a = C{Vo + 1) we obtain 

Ey,{X-''-+^)<a^C{V{yo) + l). 
Define 

TB{{yk)keNo) = inf{n G No : V{yn) < Vq and {yk+n)keNo e B} 
and 

a = inf{n > 1 : tb = Pn}- 

By assumption we have IPj/o(cr = A;) < (1 — p)^^"*^ for A; > 1. 
Let r > 1. Holder inequality implies that 



A:=l 

oo 

fc=i 

oo 



k=l 

OD 



<C{l + V{yo))J2[{^Hl-p)]'- 



k=i ' P 
Choosing sufficiently large r and setting 7 = A^ we obtain 

Ey,i^-^-)<CiViyo) + l) 
for some C > 0. Since tb < Tg, the proof is complete. D 

Lemma 2.2. Let (^^°)neNo with yo E Y be a fam,ily of Markov chains in 
metric space Y. Suppose that l^ : F — t- [0, 00) is Lapunov function for their 
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transition function {rcy : y E Y}, i.e. there exist a G (0, 1) and b > such 
that 

/ V{x)'iVy{dx) < aV{y) + b for y E Y. 

Then there exist A E (0,1) and C > such that for 

26 
p{{yk)keNo) = inf{A; E No : V{yk) < ^^j 

we have 

Ey,X-P<C{V{yo) + l) for y,EY. 

Proof of Lemma \2.^ 

Chains (y^'')„gN„, yo eY are defined on common probability space {Q, T , P). 

Fix max{a, ^4^| < a < 1 and set Vn = -^—. Define 

p((2/fc)fc6No) = inf{A; E Nq : Viy^) < Vq} 

For every yo E Y let J>i C J-", n G No be filtration induced by (F„^")„gNo- 
Define 

An = {uEn: V{Yy''{u))>Vo for i = 0, 1, ..., n}, n G No- 

Observe that ^n+i C An and ^4^ G J-". By the definition of Vq we have 
lAMV{Y,f;,)\J'n) < lA,X^V{Yyo) + b) < aU^ViYyo) P-a.e. in Q. This 
gives 

f ViYy")dF< I V{Yy'')dF= I ¥.{V{Yy'')\7n~i)dF 

J An J A„-l J An-1 

< I {aV{Yy\) + b)d¥ <a I V{Y^\)d¥. 
By Chebyshev inequality 

p(F(yo"") >Vo,..., y(yr ) >Vo)= [ nv{yr) > Vo\J'n-i)dF 

JA„-i 

< V,-' [ E{V{Yy'>)\J^n-i)dF < a^V,-\aV{yo) + b), 

JA„-i 

and 

P,„(p>n)<a"C(y(2/o) + l) for n G No- 
Fix 7 G (0,1) and observe that for A = a'^ we have 

Ey,X-^ <2 + f2^y,{X-f^ >n)< 2 + ^^i^^M±ll^^-^ = C{V{yo) + l) 

n=l n=l 

for properly chosen C. Since p < p the proof is finished. D 

Proof of Theorem 12.11 

Step I: Define new metric d{x,y) = d{x,yY and observe that for Dr = 
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{{x,y) G X^ : d{x,y) < r} we have Dr = D^ with R = R" . By Jensen 
inequahty (|3]) takes form 

/ d{u,v)Q^^y{du,dv) < ad{x,y) for {x,y) e F, (6) 

with a = a'^. Assumption A3 imphes that 

1 - \\Qx,y\\ < ld{x,y) and Qx,y{Ds,d(x,y)) > S (7) 

for {x, y) e Djin F. 

Step II: Observe, that if 6 G MjiniX^) satisfies suppb C Dj^n F then ([7]) 

imphes 

IIQfcll > \\b\\ -I / d{u,v)b{du,dv). 
Iterating the above inequahty we obtain 

llQril > II ^11 - 7-^ / d{u,v)b{du,dv) (8) 

I - a Jx2 

if suppb C Dj^ n F. Set tq = min{R, ^^} and uq = min{?7, G No : (^""R < 

To}. Now (171) and ([H]) imply, that for (x, y) G -Dr fl F we have 

IIQ.^,II>^'^"''- (9) 

Step III: Define p : (X^)^ -> Nq 

4c 

p((a;„,|/„)„gNo) = inf{n G No : L(xn) + L(y„) < _ }. 

Since L{x)+L{y) is Lapunov function for Markov chain in X"^ with transition 
probabihties {B^..^^^ : x, y G X}, Lemma [2^2] shows that there exist constants 
Ao G (0, 1) and Co such that 

E,^yX^l'<Co{L{x)+L{y) + l) for {x,y) e X\ (10) 

Define 

p{{xn, yn, On)neNo) = inf{n G No : (xn, ?/„) G Dij n F} 
and 

r((x„, y„, 6n)nmo) = infj?^ e No : {xn, yn) e DrHF and Wk>nOk = !}• 

Set A = max{f3,Xo}. Since p < p + k o Tp, where rp((x„, y„, 6'„)„gNo) = 
(x„+p,y„+p,6'„+p)„eNo, then strong Markov property, A4 and ([lO]) give 

E.,y,e X-' < CCo{L{x) + L{y) + 1) for x,y e X,e e {0, 1}. 

Define B = {{xn,yn,On)neno ■ On = ^ for n G Nq}. From Step II 
we obtain that ^x,y,e{B) > i5"« for {x,y,e) G {Dr n F) x {0, 1}. Finally 
Lemma Un\ guarantees existence of constants 7 G (0, 1), Ci > such that 

E.^y^el^^ <Ci{L{x) + L{y) + l) for x,y e X,e e {0,1}. 
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STEP IV: Define sets 



and 



G. = {teiX'x{0,l}r:rit)<-} 



H:^ = {te{X'x{0,l}r:rit)>-}. 



For every rz G N we have 

B::,,, = B- ^, Ig. +B^,y,e \h. for x,y e X,e e {0, 1}. 

Fix 9 = 1 and {x,y) G X'^. From the fact that || ■ \\fm ^ || ■ \\w it follows 
that 

II P*"A P*"-A II ll"P" "C>"-ll 

ll-r Ox — r OyllFM — Wr^ — fyWpM 

= sup| / ifiz,)-fiz2))iprfB^Jidz^,dz2)\ 

= sup| / ifiz,)-fizMp4.pr*B^,y,e)idz^,dz2)\ 
far Jx^ 

<sup| / {f{z^)-f{z2)){pr*,pr*iB^^,^^,\aMdz,,dz2)\+2B^^y/H^). 
few Jx^ ^ ' 

From A2 we obtain 

sup I / ifizi) - f{z2))ipr*,pr*{B^ j^ \Gj){dzi,dz2)\ 
w Jx^ ^ 

< / d{zi,Z2)ipr*2pr*(B'^ f)\Gn))idzi,dz2) 
Jx^ ^ 

< at / d{zi, Z2){pr*2prt{B^ g \Gn)){dzi,dz2) < a^ R. 
Now Step III and Chebyshev inequality imply that 

B^,y,e{H:.) < r^C,{L{x) + L{y) + 1) for nen. 

Taking C2 = 2Ci + R and q = max{7 2', a 2} we obtain 
1|P*"4 - P*''Sy\\FM < rCi{L{x) + L{y) + 1) for x,yeX,neN, 
and so 



||P*>-F*V||pM<7"C7i(/ Lix)fiidx)+ / LiyMdy) + l) (11) 

Jx Jx 

for yu, z/ G A^f (X) and n eN. 

Step V: Observe that Step IV and Al give 

\\P*^6,-P<^+''^S,\\fm< I \\P*''5x-P"'5y\\FMP*Hx{dy) 

Jx 

< q^C2 [ {L{x) + L{y))P*Hx{dy) < q^C^{l + L(x)), 
Jx 
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SO {P*'^Sx)neN is Cauchy sequence for every x E X. Since A1i(X) equipped 
with norm || ■ \\fm is complete (see [8]), assumption AO implies the existence 
of invariant measure /i*. Assumption Al gives /i* G A^f'(X). Applying 
inequality f lTTj) we obtain (|5]). Observation that the space A^f (A) is dense 
in All (A) in the total variation norm finishes the proof. 

n 

Remark. In steps IV and V of the above proof we follow M. Hairer (see 



3. Random iteration of functions 

Let (A, d) be a Polish space and (B, S) a measurable space with a family 
f^x G All (9) of distributions on 6 indexed by x G A. Space serves as 
a set of indices for a family {5*61 : ^ G 0} of continuous functions acting 
on A into itself. We assume that {9,x) i— )■ Sg{x) is product measurable. 
In this section we study some stochastically perturbed dynamical system 
{Xn)nen,y Its intuitive description is following: if Aq starts at xo, then by 
choosing 9q at random from 'd^^ we define Ai = Sq^^Xq). Having Ai we 
select 9i according to the distribution 'dxi and we put A2 = Sg-^{Xi) and so 
on. More precisely, the process (A„)„gN„ can be written as 

Xn+i = '5'y„(A„), n = 0, 1, . . . , 

where (Ynjnmo i^ ^ sequence of random elements defined on the probability 
space {Q, T,,prob) with values in 9 such that 

probiY^eB\Xr, = x)=^^{B) for x G A, 5 G H, n = 0, 1, . . . , 

(12) 
and Ao : fi — t- A is a given random variable. Denoting by /i„ the probability 
law of A„, we will give a recurrence relation between fin+i and fin- To this 
end fix / G -Bfe(A) and note that 

E/(A„+i) = / fdfXn+i. 
Jx 

But, by flT2|) we have 
/ d^{B)iin{dx) = proh{{Y^ G fi} n {A„ G A}) 

J A 



for Be^.AeB 



X-, 



hence 

E/(A„+i)= [ f{SY^^^){X4u))prob{du) = [ [ f{Se{x))MdO)fin{dx). 
Jn Jx Je 
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Putting / = 1a, a G Bx, we obtain /i„+i(yl) = P*/i,„(A), where 



P*fiiA)= lAiSeix))Md9)fiidx) for fi e Mfi.niX),A e Bx- 

J X Je 

In other words this formula defines the transition operator for yu„. Operator 
P* is adjoint of the Markov operator P : Bi,{X) — t- Bb{X) of the form 

Pfix) = [ fiSeix))MdO). (13) 

We take this formula as the precise formal definition of considered process. 
We will show that operator (TT3|) has a unique invariant measure, provided 
the following conditions hold: 
Bl There exists a G (0, 1) such that 

d{Se{x) , Se{y))'dx{,d9) < ad{x, y) for x,y e X. 
'0 

B2 There exists x & X such that 



c := sup / d{Se{x),x)dx{d9) < oo. 
x£X Je 



B3 A map x i— ?■ i^x, x E X , is Holder continuous in the total variation 
norm, i.e. there exists I > and u G (0, 1] such that 

{Wx — '&y\\ ^ ld{x,yy for x,y E X. 

B4 There exists 6 > such that 

Ac 
'dx/\i!}y{{0 E & : d{Se{x),Se{y)) < ad{x,y)}) > 6 if d{x,x)+d{y,x) < , 

where A denotes the greatest lower bound in the lattice of finite measures. 

Remark. It is well known (see [15]) that replacing Holder continuity in 
B3 by slightly weaker condition of Dini continuity can lead to the lack of 
exponential convergence. 

Proposition 3.1. Assume Bl - B4. Then operator f ll3p possesses a unique 
invariant measure //* G Ai\{X), which is attractive in A^i(X). Moreover 
there exist q E (0,1) and C > such that 

||P*>-//,||^M<g"C(l+ / d{x,x)fi{dx)) 

Jx 

for /i G Ml{X) and n G N. 

Proof. Define an operator Q on Bhi^X"^) by 

Qif)ix,y) = f fiSeix),SeiymxA^yid9). 
Je 

Since 

P.. A^,, -^, A^.ll < 2(11^,, -^,11 + \\^y'-^y\\) 
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it follows that 



\Qif)ix',y')-Qif)ix,y)\< / \fiSeix'),Seiy'))\\\^.' Ai}y> - ^. A^yWide) 



y "X ' ^ ^y\ 


+ / \f{Se{x'),Sem - f{Se{x),Se{yW:. A dy{de) 

< 21 snplf {z)\{d{x,xr + d{y,yr) 

+ [ \fiSeix'),Seiy')) - fiSeix),Seiym. AMdO), 
Je 

for / e BbiX"^), x,y e X. Consequently, we see that Q{Cb{X'^)) C CbiX"^), 
by Lebesgue's dominated convergence theorem. Put 

T={fe BbiX') : sup 1/(2)1 < M,Qif) G ^.(X^)}, 

where M > is fixed, and observe that the family J-" is closed in pointwise 
convergence. Therefore J-" consists the class of Baire functions bounded by 
M. By virtue of [HI Theorem 4.5.2] we obtain Q{Bb{X^)) C Bb{X^). In 
particular, for the family {Qx,y '■ x,y E X} of (sub-probabilistic) measures 
given by 

g,,,(C) = / lc{Sg{x),Sg{y))^,A^y{de), 

Je 
we have that maps (x, y) h-> Qx,y{C) are measurable for every C G Bx^- 

Arguing similarly as above we show that ( TT3l) is well defined Feller oper- 
ator. It has Lapunov function L{x) = d{x,x), since 

d{Sg{x),x){}x(yd9) < ad{x,x) + c. 
e 

Now, observe that 

||Qx,,|| =^.A ^,(6) = 1 - sup{^,(A) - ^,(A)} > 1 -Idix, yf 

for x,y G X. Moreover, we have 



d{u,v)Qx,yidu,dv) = / d{S0{x),Seiy))^x Ai:}y{d6) < ad{x,y), 
x2 Je 

and 

QxADad{x,y)) = ^xA i^y{{e G : d{Se{x),Se{y)) < ad{x, y)}) > 6 

whenever d{x,x) + d{y,x) < -^^. In consequence AO - A3 are fulfilled. 
The use of Theorem 12.11 (see also Remark concerning assumption A4) ends 
the proof. D 
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4. Perpetuities with place dependent probabilities 

Let X = M"^ and G = M'^^"' x M^, and consider a function Sg : X ^ X 
defined by Sei^x) = M{6)x + Q{0), where {M,Q) is a random variable on 
(G, S) with values in G. Then (TT3l) may be written as 

Pf{x) = f f{mx + q)d§^^ o (M, Q)-^{m, q) (14) 

Jg 

This operator is connected with random difference equation of the form 

$„ = M„$„_i + Q„, n = l,2,..., (15) 

where (M„, Qn)ngN is a sequence of independent random variables distributed 
as (M, Q). Namely, the process ($„)„,eNo is a homogeneous Markov chain 
with transition kernel P given by 

Pf{x)= / f{mx + q)dfi{m,q), (16) 

Jg 

where /i stands for a distribution of (M, Q). Equation flTSj) arises in various 
disciplines as economics, physics, nuclear technology, biology, sociology (see 
e.g. [23]). It is closely related to a sequence of backward iterations (\l/n)nGN, 
given by X]fc=i ^i ■ ■ ■ ^k-iQk^n G N (see e.g. [9j). Under conditions en- 
suring the almost sure convergence of the sequence (\l/n)nGN the limiting 
random variable 

oo 

5^Mi...M„„iQ„ (17) 

n=l 

is often called perpetuity. It turns out that the probability law of (II 7p is a 
unique invariant measure for flT6|) . The name perpetuity comes from perpet- 
ual payment streams and recently gained some popularity in the literature 
on stochastic recurrence equations (see [7]). In the insurance context a per- 
petuity represents the present value of a permanent commitment to make 
a payment at regular intervals, say annually, into the future forever. The 
Qn represent annual payments, the M„ cumulative discount factors. Many 
interesting examples of perpetuities can be found in [I]. Due to significant 
papers [H], [10], [23] and [9] we have complete (in the dimension one) char- 
acterization of convergence of perpetuities. The rate of this convergence has 
recently been extensively studied by many authors (see for instance [3]- [5], 
[T8] ) . The main result of this section concerns the rate of the convergence 
of the process (X„)„gNp associated with an operator P : Bi,{W'-) — )■ Bi,{W^) 
given by 

Pf{x)= / f{mx + q)d^^{m,q), (18) 

Jg 
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where {fi^ : x G M'^} is a family of Borel probability measures on G. In 
contrast to ($„)„gNo; the process (X„)„gNo moves by choosing at random 
9 from a measure depending on x. Taking into considerations the concept 
of perpetuities we may say that {Xn)neNo forms a perpetuity with place 
dependent probabilities. 

Corollary 4.1. Assume that {^^ '■ x G M'^} is a family of Borel probability 
measures on G such that^ 

a := sup / ||m||(i^2:(m, g) < 1, c := sup / \q\djix{fni q) < oo. (19) 

xm.'^ Jg xgM'' Jg 

Assume moreover that a map x i— )■ fi^, x E X , is Holder continuous in the 
total variation norm and there exists (5 > such that 

4c 



/i^ Ay[Xy({(m,g) G G : ||m|| < a}) > (5 if \x\ + \y\< — 



a 



Then operator ( TT8|) possesses a unique invariant measure //* G A1J(M ), 
which is attractive in Aii{M.'^). Moreover there exist q G (0, 1) and G > 
such that 



||F*>-/x,||i.M<g"C(l+ / \x\fi{dx)) 

for fi G MliW^) and n G N. 

The proof of corollary is straightforward application of Proposition 13.11 We 
leave the details to the reader. We finish the paper by giving an example 
to illustrate Corollary 14.11 

Example. Let pq, pi be distributions on M^. Assume that p, g : M — ;■ [0, 1] 
are Lipschitz functions (with Lipschitz constant L) summing up to 1, and 
p{x) = 1, for X < 0, p{x) = 0, for x > 1. Define Hx by 

Hx = p{x)i^o + q{x)iyi, x eR. 

Then: 

(1) Wfix- fJ'yW <'2L\x-y\ for x,y eR. 

(2) If Jjg2 |m|dt'j(m,g) < 1 and f^2 \Q\di^i{m,q) < oo for z = 0, 1, then 
(dni) holds. 

(3) For every A G i3iR2, x,y E R we have: fix A fJ.y{A) > Uq A i^i{A) = 
{uo - A+)(/l) = (z/i - X-)iA) > ma.x{uo{A),u,{A)} - \\i^o - ^^i||(^), 
where (A+, A") is a Jordan decomposition of z/i — uq. 



\\m\\ — sup{|?7ia;| : x G W^, \x\ = 1}, and | ■ | is Euclidean norm in 
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